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Given these descriptions, we will explore several issues concerned with 
pilot decision making in computer-aided flight management situations. Is 
system performance enhanced by .computer aiding? How effective are different 
aiding policies? How does the pilot feel about aiding? Is his role or 
performance affected? ..To investigate the feasibility of the approach, and to 
predict the effects of numerous system variables and aiding policies, a 
queueing formulation of multi-task decision making was developed and will be 
discussed in the next section. 

, APPROACH 

The pilot in the automated flight management system described earlier 
has a variety of tasks to perform. As the number and variety of tasks 
"increases, the workload of the pilot is increased. It is essential to 
appropriately allocate his attention and effort among the tasks. He may be 
in a situation that he wants both to monitor the tasks often enough to reduce 
growing uncertainty and risk, a- 1 to perform a task quickly and accurately to 
lessen the cost involved in the delay of action. This issue is being 
investigated by Greeftstein and Rouse [3]* To simplify the issue, the pilot 
is assumed to employ a quasi -optimal decision making strategy for scanning 
displays and allocating attention. This is based on the assumptions that the 
tasks are independent and that events unequivocally present themselves. The 
pilot scans the task display in order of decreasing priority at a given rate. 
He then performs the first task for which he perceives some action-evoking 
events. The computer is assumed to adapt the same strategy either by being 
hard-wired or learning from the pilot. Now we may look at the multi-task 
decision making as a queueing system with two servers (the pilot and the 
computer) and K+1 classes of customers (K subsystem events plus control 
events represented by displayed 4-D errors in manual control mode) . 

In the queueing model, each server is characterized by his observation 
of system state, his perceptions of event occurrences, of event arrival rates 
and of event service rates. Combining the above information and the system 
cost criteion allows the model to predict system performance measures such as 
event delay statistics and server occupancy which is fraction of time the 
server is busy. 

A convenient cost criterion, in terms of a stationary expected cost 
structure, includes waiting cost, service cost, and switching cost. When the 
computer service cost and switching cost may be negligible, the optimal 
policy is to have the computer on all the time. However, it is more likely 
that the human will be better at performing the task but not have sufficient 
time to do all the tasks. Also evidence of vigilance and warm-up decrements 
suggests that there is an acceptable workload range that sustains performance 
on long tasks. Thus we may want to seek a policy for computer aiding such 
that a minimum waiting cost is achieved while maintaining a specified 
workload level. 

Based on results from literature t**3, we will advocate the use of the 
stationary expected cost policy, subject to minimizing deviation from 
acceptable pilot workload, for computer on-off of the following form: turn 
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the computer on at arrival epochs when N s c.n- + CgOp + ••♦ + ^ 

turn it off when N < m, where c.., c,* Cj, are cost rates assessed 

according to relative priorities and n. is the number of events waiting in 
the subsystem k. This policy (i.e., M and m) should vary as the system 
variables vary. Specific values of M and m have to be determined for various 
levels of traffic demand (i.e., event arrival rates), server performance and 
task complexity (i.e., service rates and probabilities of errors). An 
appropriate approach to implement the adaptive policy is to set up a table of 
stationary control policies beforehand and to employ a table look-up along 
with on-borad estimation of system variables. 

To obtain the optimal stationary policy, i.e., to determine the values 
of M and m, a computer simulation was performed. Poison arrivals and Erlang 
service time distributions for subsystem were assumed. The K subsystem tasks 
were preempted by the control task whenever it occurred. The system was 
represented as a preemptive resume priority queueing systems 
(M/Ej^/2);(PRP/K/K) with implemented threshold control. 

A simple case was considered in which the model parameters were 
determined in the following manner. 1) Subsystem arrival rates, service 
rates, and waiting cost rates were all uniform among the subsystems. 2) Two 
levels of arrival rates were assumed, i.e., low arrival (at 0.0167 events per 
second) and high arrival (at 0.0333 events per second). 3) Pilot performance 
in terms of service rates, service errors and control services were obtained 
from the experiment discussed in the next section. 4) The computer aiding 
employed the same service rates as the pilot and automatically went off when 
no event needed service (i.e., msO). The results based on the computer 
simulation of 10,000 events for Ka6 and server occupancy for pilot of s 0.7 
showed that, without control task, M*7 for low arrival and 3 for high 
arrival; with control task, Ms3 for low and 1 for high arrival. If workload 
is the primary consideration, these are threshold values which the computer 
should employ to adapt to both the subsystem arrival rate and the control 
task involvement. 

Prediotion of system performance by the model was also obtained through 
the computer simulation. The results will be discussed in the later section. 

THE EXPERIMENT 

Two experiments are to be discussed here. A brief review is given of an 
experiment previously reported by Walden and Rouse [5] investigating pilot 
decision making in an unaided situation. The second experiment, considering 
the computer aiding and autopilot malfunction situations, employs basically 
an outgrowth of the experimental representation used in the previous 
experiment . 

The experimental situation developed earlier [6] used a PDP-11 driven 
CRT graphic system to represent a cockpit-like display to an experimental 
subject. The display shown in Figure 1 included standard aircraft 
instruments such as artificial horizon, altimeter, heading and airspeed 
indicators. Also displayed was a flight map whioh indicated the airplane’s 
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The results showed that, while average waiting time increased with subsystem 
event arrival rate, the average service time appeared to be independent of 
subsystem arrival rate. The waiting time was also shown to increase as the 
control task was added. This effect was only a function of the mere presence 
of the control task, rather than the control task difficulty. Incorrect 
actions in servicing subsystems tended to increase with subsystem arrival 
rate, but showed no consistent variation with control task difficulty. False 
alarms, however, tended to occur more frequently with the easier control task 
and lower subsystem arrival rate. This presented evidence of performance 
degradation under low workload situations. 



1^*4 collected was used in the queueing model of pilot decision 
making in an unaided monitoring and control situation. The model gave a 
reasonable prediction of pilot performance in performing subsystem tasks, 
suggesting ^lat it was an adequate description of pilot decision making in 
Sding^system'**^^*” * similar model would be useful in the adaptive 

^sed on the experimental representation discussed above, a new 
situation for adaptive aiding was developed with the aiding 
program (i.e., the computer decision maker) and the coordinator program 

the caMbi?JtJ original system. Issues concerning 

the capability of the computer to perform the subsystem tasks, the 

communication link^e between the pilot and the computer, and the aotivities 
of the coordinator deserve further discussion. 
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Table Design of Experiment. 
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For the experiment runs with perfect autopilot, only the subsystem task 
was considered. An "autopilot" kept the aircraft on course and on schedule. 
These runs served as baseline performance for the subsystem task. In the 
manual control runs, the subject had to perform both subsystem and control 
task. He was told that the control task was sore important than the 
subsystem task. For the runs where autopilot maufunotions were poslble, the 
autopilot was available during most of the experiment such that the subject 
was not required to fly the airplane except to occasionally check autopilot 
performance. As soon as he detected an autopilot malfunction, whioh was 
characterized by the airplane deviating from the napped course at a rate of 
one degree per second, he was required to take over the flight control tas*', 
and fly the airplane back to the mapped course. In this case, the airplane 
would lock on the desired course as soon as it flew within the 800>feet oval 
of the on^sohedule circle, and the autopilot node was restored. The 
autopilot malfunction happened relatively infrequently, based on a Poison 
distribution with mean inter-arrival time of 160 seconds. 
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separate test showed that the adaptive policy was also significant, i.e., the 
adaptive aiding further reduced the subsystem waiting time beyond the 
fixed-threshold aiding, even though the adaptive policy was only effective 
during a small portion of time in the experiment. 


The subjective ratings of the level of effort across subjects are shown 
in Figure 5 Factors of significance include all three experiment variables. 
As expected, the perceived level of effort increased as control involvement 
increased, as subsystem arrival increased, and as computer aiding was 
removed. However, a separate test showed that the effect of the adaptive 
policy was not significant, probably because the adaptive policy was employed 
rather infrequently, and when it was being used, the subjects usually were 
too involved with restoring the autopilot to notice the fact that the 
computer way hel,ping more often then usual. 
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Figure 4 Average Subsystem Delay. 



Figure 5 Subjective Ratings of Effort. 


The RMS course error across subjects is shown in Figure 6. The analysis 
of variance showed that only control mode had an effect on the control error. 
No consistent variation in the course error was shown as subsystem arrival 
rate or aiding situation varied. The lower course RMS error for the 
autopilot malfunction mode probably resulted from subject's more intense 
attention to the control task in the case of malfunction. 


The RMS roll angle across subjects is shown in Figure 7. Also, only 
control mode had a significant effect on the control input. The subjects 
were found to use more extreme control actions and more attention to fulfill 
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the malfunction task requirements. S^arizing ^e«B *to 

rfpsiimed to relax control requirements, such as the autopilot, seem to 

improve both control and subsystem performance, while systems 
designed to relax subsystem requirement, such as computer aid g ^ g y 
reliable subsystems, seem to improve only subsystem performance . ^The 
Dossible reason for this is that the control task perempts subsystem tasks, 
a^thts, thrcon^^^^^ task inefficiency is likely to affect the performance 
of subsystem tasks; the reverse is not true. 




Figure 6. BMS Course Error. 


Figure 7* RMS Roll Angle. 


Subjective ratings of three aspects of 
determined: effectiveness, desirability ®f .^^^® 

interaction with the aiding. The results indicate that the aiding was 
considered easy to interact with and desirable by the subjects. J^s effect 
on performance improvement was perceived to be from moderate to large. The 
subjects perceive the aiding to be relatively more effective and more 
desirable with a high subsystem arrival rate or a high control involvement 
aifcuation They, however, did not feel that it was more difficult t 
interact with the aiding in those situations. In fact, all the subjects were 
cuite in favor of both the aiding scheme used in the experimental situation 
^i thegenZl computer aiding idea. More analyses of performance measures 
are discussed by Chu in his thesis [71 • 

The empirical data were compared with simulation results from the 
queueing model of pilot decision making in computer aided situation discussed 
Lrlier! This allowed an evaluation of the model's ability to represent the 
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' situation. The comparison of subsystem Waiting statisticd is shown in 

Table 2. 

T§ble 2. Comparison of Waiting Time. v 


Arrival 

Aiding 


Mean 

Standard Deviation 

Rate 

Type 

Model 

Data 

Model 

Data 

Autopilot Mode 





Low 

No Aiding 

9.73 

9.71 

5.39 

6.04 

Low 

Aiding 

9.34 

9.82 

4.30 

5.13 

High 

No Aiding 

14.71 

15.79 

13.46 

14.21 

High 

Aiding 

13.79 

13.16 

12.00^ 

7.43 

Manual Mode 



'■ 


Low 

No Aiding 

20.13 

23.62 

16.24 

23.53 

Low 

Aiding 

17.56 

17.17 

10.26 

11.31 

High . 

No Aiding 

32.87 

27.81 

45.51 

28.64 

High 

Aiding 

19.58 

19.19 

11.85 

12.17 

Autopilot Malfunction Mode 




Low 

No Aiding 

12.00 

14.25 

8.85 : 

13.81 

Low 

Aiding^ 

11.13 

12.84 

6.79 

10.52 

Low 

Adaptive Aiding 

10.25 

10.68 

4.91 

5.52 

High 

No Aiding 

17.47 

19.03 

18.96 

21.16 

High 

Aiding 

13.66 

15.52 

8.52 

11.55 

High 

Adaptive Aiding 

12.32 

13.25 

7.10 

8.33 


® Poison distribution of control event arrivals and an 
Erlang distribution of control service times with shape parameter k=2 were 
assumed. To generate the results in Table 2, the values of 0.1 sec‘^ (in 
manual mode) and 0.16 (in malfunction mode) were used as mean control arrival 
rates, and 0.47 and 0.34 as mean control service rates. These values were 
obtained by analyzing subject's aileron control input and, serve as a first 
approximation. 

The results compare reasonably well. All parameters in the model were 
empirically measured and no adjustments were made. The model predicts 
performance in autopilot mode very well. A better estimate of control task 
parameters wlJl surely improve the model accuracy in manual control and 
autopilot malfunction modes. 


CONCLUSION 

The experimental results show that all the experimental variables, i.e., 
the subsystem arrival rates, the control task involvement, and the 
computer aiding, were statistically significant in terms of 
affecting the performance measures of interest, mainly, the subsystem delays, 
and subjective effort ratings. It was shown that the aiding enhanced system 
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